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ABSTRACT 

Business schools are currently being criticized for lacking relevance to the applied working 
environment in which students are supposed to be prepared to make immediate contributions and 
reasoned independent decisions in a fluidly changing market (Haskell and Beliveau, 2010, and 
Michlitsch and Sidle, 2002). While technical skills (accounting, marketing, finance, etc.) have 
comprised the core of traditional course subject matter, today’s businesses also need graduates 
who arrive to work possessing integrative skills such as adaptable decision-making in changing 
competitive environments. 

Teaching and assessing integrative adaptive behavioral outcomes is both a break from the norm 
and a challenge to those tasked with developing assessment standards and rubrics. Discussing the 
demand for developing and assessing adaptive learning skills in business schools is the easy part. 
Incorporating the development of these non-technical skills into curricula or programs of learning 
requires one to identify specific skills that require adaptive improvement, design specific 
pedagogy to develop the skills, and longitudinally measure student performance. In reality, many 
business curricula lack learning environments where integrative non-technical skills such as 
longitudinal adaptive behavior can be isolated and programmed for improvement. 

This manuscript identifies an experiential inductive-based teaching method that has been extended 
to account for longitudinal variation in adaptive behavior-based learning. It describes a holistic 
course pedagogy that builds on traditional theoretical knowledge, but then requires students to 
actively apply that knowledge using interdisciplinary decision-making that receives ongoing 
competitive market feedback. An assessment rubric is also suggested for linking to important 
AACSB Assurance-of-Learning objectives targeted at measuring behavioral-based outcomes 
related to applied adaptive decision-making behavior. Finally, methods are suggested in which 
adaptive behavioral outcomes can be integrated into other forms of more traditional pedagogy. 
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INTRODUCTION 



jusiness schools are currently being criticized for lacking relevance to the applied working 
environment in which students are supposed to be prepared to make immediate contributions and 
reasoned independent decisions in a fluidly changing market (Haskell and Beliveau, 2010, and 
Michlitsch and Sidle, 2002). While technical skills (accounting, marketing, finance, etc.) have comprised the core of 
traditional course subject matter, today’s businesses also need graduates who arrive to work possessing integrative 
soft-skills such as interpersonal communication, teamwork, competitiveness, and adaptable decision-making in 
competitive environments. 


In an era of mounting assurance-of-learning assessment in business schools, teaching and assessing 
integrative adaptive soft-skills is both a break from the norm and a challenge to those tasked with developing 
assessment standards and rubrics. Discussing the demand for developing and assessing soft-skills in business 
schools is the easy part. Incorporating the development of these non-technical skills into curricula or programs of 
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learning requires one to identify specific skills that require adaptive improvement, design specific pedagogy to 
develop the skills, and longitudinally measure student performance. In reality, many business curricula lack learning 
environments where integrative non-technical soft-skills such as longitudinal adaptive behavior can be isolated and 
programmed for improvement. 

BACKGROUND AND SCOPE 

This manuscript focuses on the assessment of student abilities to compete and adapt decision-making in a 
rapidly changing market environment that contains both controllable and uncontrollable variables. The primary 
research question asks “how does one ensure student learning related to adaptive behavioral-based decision-making 
outcomes in a fluidly changing competitive market environment?” Adapted from Clarke (2009), adaptive behavior 
is defined as evidence of targeted longitudinal change in a decision maker’s mental models through active 
observation of the consequences of actions. The research question is important because traditional marketing classes 
often use pedagogy like lecture, case study, video cases, discussion, projects and presentations. These methods do 
not extend learning beyond a mostly static knowledge application realm of assessment. Assessment of actual 
adaptive learning behavior related to longitudinal application of that knowledge is therefore limited using these 
tools. However, an experiential-based teaching method (Prince and Felder, 2006) can be extended to account for the 
assessment of certain adaptive behavioral outcomes. Table 1 defines adaptive behavior and its assessment. 


Table 1: Adaptive Behavior Definition and Assessment 


Skill Assessed 

Definition 

How it is assessed 

Adaptive Behavior 

Evidence of targeted longitudinal change in a 
decision maker’s mental models through active 
observation of the consequences of actions 
(adapted from Clarke 2009 ) 

Adaptation of Strategic and/or Tactical Decisions 
Improved Management Performance (over multiple 
decision rounds) 

Improved Marketing Performance (over multiple 
decision rounds) 

Improved Financial Performance (over multiple 
decision rounds) 


An increasing number of instructors are using computer-based simulations as supplemental learning tools 
which focus on applied behavioral learning objectives. Introduced in 1956 by the American Management 
Association (Cohen and Rhenman, 1961), business simulations have grown substantially in business schools over 
the last 10-15 years. Research has shown that students perceive simulations as being 1) engaging, 2) useful, 3) 
effective learning tools, and 4) effective in promoting teamwork (Lainema and Lainema, 2007). As noted by Clarke 
(2009), business simulations are particularly suited to operationalize theoretical knowledge into experiential 
knowledge (Anderson and Lawton, 2004; 2009), adaptable decision-making (Cadotte, 1995), adaptable learning 
(Aldrich, 2005, and Senge, 1995), and behavioral, attitudinal, and cross-functional knowledge change (Sherpereel, 
2005). 

Incorporating Adaptive Behavioral Outcomes into Course Embedded Assessment 

Most important to the pedagogical advancement proposed in this paper, a computer-based simulation used 
within a specific context can assess adaptive behavior related to longitudinal decision-making in a competitive 
business environment. It is this very context that makes simulations unique. Assessing longitudinal adaptive 
behavior is inherently difficult to replicate using other types of pedagogy. Finally, related to linking course teaching 
objectives to assurance-of-learning in accreditation assessment, this manuscript also suggests an assurance-of- 
learning rubric related to AACSB assessment of adaptive behavior in a competitive environment. 

At the undergraduate level and particularly at the graduate level of study, students increasingly have work 
experience and are aware of the need for higher order applied adaptive decision-making in a cross-functional 
competitive environment. However, traditional pedagogy is limited in its ability to provide a competitive inter¬ 
disciplinary environment that includes experiential-based adaptive decision-making outcomes. Students understand 
they will be expected to compete in a global marketplace and they also understand that learning and communication 
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in the “real world” extends beyond textbooks, written reports, and static exams of knowledge. Beyond traditional 
teaching pedagogy, there is a higher order of applied inductive thinking that requires one to critically apply technical 
knowledge longitudinally into a competitive market environment. This requires integrative, adaptable behavior and 
decision-making skills. This manuscript outlines one way in which this level of higher order adaptive behavioral- 
based thinking can be incorporated into the marketing classroom. 


Analysis Papers 

Case Study 

Video 

Discussion 

Business Planning 

Market Planning 

Service Based Learning 



Figure 1: Pedagogical Positioning 


Competitive Simulation 
within a longitudinally 
changing market 
environment 


Figure 1 illustrates the pedagogical positioning of adaptive behavior within the context of building 
knowledge pedagogically first through fundamental theoretical knowledge, then further through critical thinking 
methods, and ultimately building to integrative applied adaptive behavior. This manuscript proposes an approach to 
assessing adaptive behavioral development by creating a business environment via competitive computer-based 
simulation requiring students to strategically plan for controllable business forces. However, it also requires 
students to longitudinally adapt to uncontrollable competitive environmental forces within their decision-making 
process. 


As with many simulations, students are required to compete against each other or simulated competitors in 
a business marketing context. The learning outcomes for this exercise are predicated on the need to operationalize 
static, theoretical knowledge from text and lecture into informed decisions which enable their firm to effectively 
compete in a longitudinally changing marketplace. This type of inductive teaching method helps faculty ground 
theory in applied behavioral outcomes by allowing students to experience the results of their decision-making 
longitudinally; thereby allowing them to adapt their behavior in successive decision-making rounds (Prince and 
Felder, 2006). 

The student is provided with a case study and a student decision-making guide provided by the simulation 
provider. In addition, traditional pedagogy is integrated into the overall course design using lecture and course 
material related to strategic marketing planning and balanced scorecard theory into the buildup to the beginning of 
the simulation. The simulation experience is graded using a three tiered assessment to fully achieve the desired 
learning outcomes. First, each student receives a grade for their competitive performance in the simulation itself. 
Second, student groups are required to prepare a comprehensive shareholder report that links to the general structure 
and content of shareholder reports in publically traded institutions. Third, students are required to complete 
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individual-based learning outcome papers that elicit them to critically assess and apply what they have learned from 
the simulated environment to what they experience or see in the actual business environment. 

When used effectively, simulation-based adaptive behavioral outcomes are integrated into a holistic course 
grading rubric to assure integration of the exercise into an integrative pedagogy for the entire course. Using an 
undergraduate International Marketing course as a basis. Table 2 identifies adaptive behavioral-based learning 
outcomes that would otherwise be difficult to attain without the use of a competitive simulation as an integrative 
pedagogical tool. It also provides an example of an integrative course grading rubric utilizing all three levels of 
pedagogy illustrated previously in Figure 1. 


_ Table 2: Pedagogical Objectives and Suggested Integrative Course Assessment Rubric _ 

Pedagogical objectives of adaptive competitive engagement through integrative simulation _ 

Competitive application of knowledge of strategic international marketing theory such as channel strategy, adaptive 

segmentation, targeting, pricing strategy, and competitive innovation management. _ 

Competitive application of marketing research for brand development, implementation, and adaptation for international markets. 
Applied strategic marketing planning and adaptive strategic planning in a fluidly competitive business environment. 

Applied cross-cultural adaptation to environmental scenarios related to consumption, product preferences, cultural values, and 
perception of products and advertising. 

Applied competitive engagement of text-based theory in a fluidly changing interdisciplinary decision-making organizational 

environment. _ 

Adaptive management decision-making and market-based feedback requiring interdisciplinary understanding of accounting, 
production, and finance activities. 


3 Exams @100 points each (Lecture and Text-Based) 

300 points 

60% 

Computer Simulation Competition 

75 points 

15% 

Group Simulation Shareholder Report 

50 points 

10% 

Individual Simulation Learning Outcome Analysis Paper 

50 points 

10% 

Peer Reviews of Group Participation 

25 points 

5% 

Total 

500 points 

100% 


Assurance of Learning and Assessment 

This manuscript extends traditional business simulation assessment by integrating adaptive behavioral- 
based learning objectives into a holistically designed course pedagogy. Teaching and assessment of adaptive behavior 
is important because it captures activities involved in the longitudinal evaluation and control portions of the 
marketing planning process. In addition to the pedagogical advancement gained from using a competitive market 
simulation within this context, it is also possible to achieve AACSB Assurance-of-Learning accreditation objectives 
related to applied adaptive behavioral outcomes. Table 3 suggests an acceptable AACSB Assurance-of-Learning 
rubric for evaluation of behavioral-based outcomes utilizing a competitive business marketing simulation. 

As noted by Haskell and Beliveau (2010), newly implemented AACSB standards require that schools use 
direct measures of assessment in student learning objectives. For example, students must be able to demonstrate 
knowledge. Traditionally, this has been done through written deliverables such as examinations and written papers. 
However, behavioral outcomes such as longitudinal competitive engagement, decision-making, and adaptive 
application of theory are difficult to assess using these methods. Specifically, by effectively using balanced 
scorecard and other cumulative key performance metrics, it is possible to quantitatively assess longitudinal 
behavioral outcome achievement of specific learning objectives. For example, one way to do this is by assessing a 
comprehensive performance measure of the number of students that are able to achieve a positive cumulative total 
shareholder return at the end of the simulation. Another way is to use comparative class level balanced scorecard 
achievement metrics related to financial, customer, process, and learning and growth within the course of the 
simulation. 
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Table 3: Suggested AACSB Assurance of Learning Rubric 


| Adaptive Behavior Rubric ! 


lWeak 

2 Needs to Improve 

3 Effective 

4 Very Effective/Strong 

Score 

Adaptation of 

Strategic 

and/or 

Tactical 

Decisions 

Decisions have 
not changed from 
one decision 
round to the next. 

Modifications to 
decisions have been 
made but do not result 
in positive 
improvement in 
business performance 

Modifications to 
decisions have created 
positive improvement in 
business performance but 
have not established 
competitive advantage 

Modifications to decisions 
have created positive 
improvement in business 
performance and have 
established competitive 
advantage 


Improved 

Marketing 

Performance 

Marketing 
effectiveness has 
not changed over 
the course of the 
game. 

Marketing 
effectiveness has 
varied over the course 
of the game but has 
not established a 
positive trend. 

Marketing effectiveness 
has increased in a 
positive direction over 
the course of the game 
but has not exceeded that 
of the competition. 

Marketing effectiveness 
has increased in a positive 
direction over the course 
of the game and has 
exceeded that of all 
competitors. 


Improved 

Financial 

Performance 

Financial 
performance has 
continuously 
decreased over 
the course of the 
game. 

Financial performance 
has varied over the 
course of the game but 
has not met the course 
goal. 

Financial performance 
has increased in a 
positive direction over 
the course of the game 
and has met or exceeded 
the course goal. 

Financial performance has 
increased in a positive 
direction over the course 
of the game and has met 
or exceeded the course 
goal by over 10% or 
more. 



However, there are some pedagogical challenges that should be noted. To create the adaptive behavioral- 
based learning outcomes described in this paper, the simulation must be 1) integrated as into a holistically designed 
syllabus with other forms of traditional pedagogy, 2) be competitive with winners and losers, and 3) include 
multiple, longitudinal periods of decision-making where students or groups of students are required to adapt to 
controllable and uncontrollable market forces affecting the ongoing success of their business strategies. 

CONCLUSION 

This manuscript has focused on an approach to integrating and assessing adaptive behavioral outcomes 
holistically into business course pedagogy. It also suggests a method and rubric that can be adapted for use in 
AACSB Assurance-of-Learning assessment related to adaptive decision-making behavior. When used in this 
context, a computer simulation can be utilized to assess adaptable behavior at various levels of business knowledge 
and experience. Depending on the level of student, simulations can be used to build behavioral-based learning 
outcomes through sequential, step-by-step tutelage on a period by period basis. They can also be used to require 
students to inductively “figure it out” solely based on the application of knowledge and consequences of decisions. 
The former has been particularly suited to students studying at the undergraduate level, while the latter has proven to 
be better suited to the graduate business study level. At the graduate level, core interdisciplinary marketing, 
accounting, finance, and production knowledge is assumed, so the behavioral-based outcome objectives are adapted 
to include higher level, more complex inter-disciplinary decision-making. 

More traditional pedagogy can also be adapted to take into account adaptable behavior outcomes. For 
example, case studies that are designed with decision-making “rounds” in longitudinal sequence could be adapted to 
the suggested assessment rubric. Using this method, new decision-making variables requiring ongoing student 
decision-making adaptation could be introduced into each round of decision-making. Ultimately, cases could be 
designed with alternative scenario outcomes for each round that build in different directions based on student 
adaptive behavior to the variables presented each round. This would provide more longitudinal depth to the case 
study method and build student knowledge through inductive applied decision-making. 
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